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ABSTRACT 



This document outlines the research and development 



collect 



( 2 ) 

manage 



of a consortium of organizations whereby they might (1) 
training materials to meet identified needs for persons with 
development and evaluation skills In education and industry, 
establish a system for data collection and decisionmaking to 
the individualized instruction of persons In development and 
evaluation training programs, (3) find trained personnel to 
immediate needs of educational and Industrial organizations, and (4) 
make arrangements for delivery and iinance of training programs to 
meet long-range needs for pre- and In-service training in development 
and evaluation. Each objective is documeftted and detailed into 
specific outcomes and/or tasks. Subcontracts and budgets are 
presented along with a time line for project completion. Related 
are EA 003 901, EA 003 902, 'and EA 003 903. (Author/RA) 
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I am enclosing the series of docimenta contracted for in response 
to RFP 70-12. The agreed-upon objectives of our design activity, 
and the pertinent documents are; 



1) a detailed study of personnel needs in schools, 
industries, laboratories, and research and 
development centers . 

Design Document I (The Need for Research, Development, 
Dissemination, and Evaluation Personnel in Education) 
presents the results of a manpower survey conducted by 
our Consortiunn. 

2) an analysis of training inputs. 



The Propcsal for a Midwest Ikiucatlonal Training Center 
outlines the capabilities and contributions of members 
of the Consortium in training for development and 
evaluation. 



3) a plan for training Instruction researchers, developers, 
evaluators, and support personnel. 
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Design Doc um ent III (The Management System) describes the 
organization and management of an individualized training 
program for specialized personnel. 

4) a proposal whereby the Consort iim might implement the 
above plan. 

The Proposal for a Midwest Sducatlonal Training Center 
states a program of action and budgets pertinent to 
implementation of the training plan, 

5) a paper outlining the theoretical structure on which 
instructional development is fomded. 

Design Document XI (Conceptual Papers Defining the Know- 
ledge and Skills Required to Function as Educational 
Developers and Evaluators) states the rationale underlying 
training in educational development and evaluation and 
provides a collection of training objectives. 

I hope that you will agree that our contracted work Is completed and 
that the Consortium deserves careful consideration for receipt of 
continued support for research and development in this Important 
area. 




William Araaentorp 



WA/mb 



Enclosures 



Prime Contractor for Operationeil Phase ; Upper Mid'west Regional 

Educational Laboratory 

Project Director for Operational Phase ; William Ammentorp, Director 

Wayne Welch, Co-Director 



Prinalpal Partlclpantg in Operational Phase 



Institutions 



individuals 



Upper Midwest Regional 
Educational Laboratory 



William .^nmentorp 
Jon Morris 
Geraldine EvanG 



Educational Research & Tom Stark 

Development Council 

Division of Educational Vernon Hendrix 

Administration 



Department of Psychological 
Foundations 



Control Data Corporation 



Wayne Welch 
Paul Johnson 
John Rhetts 
James Tervilliger 

Robert Fallon 
Tom Mehrlng 



Southwest State College 



Richard Wollin 
Roger Raymond 



Major manpower needs being addresaed ; 

1) Persons capable of carrying out evaluation of educational 
products and programs in schools and Industries. 

2) Persons skilled in identifying training problems and 
developing instructional materials and techniq.uee to resolve 
said problems. 

Unique features of rationale, content, and process of the proposed design : 

The Consortium is a unique combination of educational and industrial 
talent with a common interest in development and evaluation of educational 
products and programs. The proposed design develops and deliver;", 
instruction in educational evaluation and development to persona In 
industrial and educational organizations. The guiding principle of the 
Consortium is that training should be provided in terms of desired 
terminal behaviors rather than in terms of courses taken or time spent. 

To this end a set of terminal behaviors has been developed for education al 
developers and ev a luators. Training modules designed to achieve these 
behaviors will be designed and administered on an individual basis, A 
detailed monitoring and management system has been developed to implement 
this Individualized training program. 
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Part 1 - THE ABSTRACT 

The consortium of organizations listed on the cover sheet of 
the doc um ent proposes to engage in cooperative efforts to attain 
the following objectives i 

1) A collection of training materials to meet 
identified needs for persons with develop- 
ment and evaluation skills in education 
and Industry. 

2) A system for data collection and decision 
making to manage the individualized instruc- 
tion of persons in development and evaluation 
training programs. 

3) Trained personnel to meet the Immediate needs 
of educational and industrial organiiatlons. 

4) Arrangements for delivery and finance of 
training activities to meet long-term needs 
for pre- and in-service training in develop- 
ment and evaluation. 

The following pages outline the research and development plans 
of the Consort i\mi whereby the above objectives might be realized. 
Each objective is documented and detailed into specific outcomes 
and/or tasks which the Consortium will undertake to carry out. 
Subcontracts and budgets are presented along with a time line, 
for project completion. 



O 

ERIC 



7 



- 2 - 



The reader should consult the three "Design Documents" prepared 
by the Consortium from which the above four objectives were derived. 
These are: 

Design Docimient I - "The Need for Research , Development, 
Dissemination and Evaluation Personnel in Education." 

Design Document II - "Conceptual Papers Defining the Knowledge 
and Skills Required to Function as Educational Developers and 
Evaluators . " 



Design Document III ~ The Management System." 





Part 2 - PROPOSAL DOCUMENTATION AND DETAILED OBJECTIVES 



Training Priorities for Education Development an d Evaluation 

The training outcomes selected by the Consortium were derivea 
from two sources; studies of projected manpower needs and analysis of 
knowledge and skills needed to fill roles in educational develop- 
ment and evaluation. The primary source document for determining 
personnel needs is Design Document I (DDI) The Need for Research , 
Development, Dissemination and Evaluation Personnel in Education. 

The conclusions of DDI indicate that initial training for educa- 
tion development and evaluation should be primarily fociised on 
public elementary and secondary school roles. These roles may be 
categorized as supervisory, where the task emphasis is on evalua- 
tion of educational materials and programs, or technical, with a 
task emphasis on development and use of instructional mai'erials, 

DDI further documents the magnitude of personnel needs in the 
five state region (Minnesota, Wisconsin, Iowa, North Dakota, and 
Souuh Dakota). 

Design Document II (DDII) outlines the knowledge and skills 
needed for persons who are to carry out the above roles, DDII 
specifies hierarchies of objectives which comprise the clusters 
of skills required by educational employers. The combination of 
these two Design Documents results in the identification of 
training materials which the Consortlim proposed to develop. 

The objectives below simmerize the materials development phase 
of this project! 

O 

ERIC 



9 



- 61 - 



OBJECTIVE FOUR: The learner will meet together with an Instructor, 

and any other learners who are also ready for this 
objective at the same time, to discuss the prepared 
list(s) of objectives. The discussion will focus 
on evaltiating the objectives in terms of: 

A) their clarity and behavioral specificity (i.e., 
whether an objective reader can tmderstand the 
written statements and can readily infer wtiat 
the writer would in fact do). 

B) their appropriateness and priority for focusing 
the writer’s learning during the period of this 
"course.” 

RATIONALE: This objective is designed to provide the learner with 

some external feedback concerning his work to date. In 
addition, if at all possible this feedback will be 
effected in a small group context. Cooperative efforts 
among group members can be extremely facilitative of 
laaming, in that the chances are good that each person 
can profit from the comments and perspective of others 
in clarifying each groixp member’s objectives. This is 
itself a learning experience for all. Also, the task 
orientation can in turn serve to initiate and facilitate 
further interactions among members of the group, thus 
developing and/or reinforcing grotip member/s interper- 
sonal communications skills. 

LEARNING ACTIVITIES: Bring your lists of objectives and meet with 

the instructor (plus any other learners who 
are also ready) to disciiss and evaluate your 
objectives. You can anticipate that the 
instructor will make suggestions about neces- 
sary and/or appropriate additional objectives 
for your activity as will revisions in objec- 
tives you have stated yourself. 

PERFORMANCE CRITERIA: You will subsequently produce amended sets 

or lists of objectives, incorporating necessary 
and appropriate revisions, additions, and 
deletions to your initial lists of objectives. 
Th-tfi "second-generation" document will be the 
input for Objective Five. 
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1) Training materials for instructional problem 



analysis and programming. 



2) Training materiais for analysis and use of 



instructional technologies. 



3) Training materials for evaluation design and 



interpretation. 



4) Training materials for organizing and imple 



menting evaluation in education. 



A Management System for Individualized Instruction 

The Consortiim recognizes that persons seeking training in 
educational development and evaluation are likely to possess varying 
degrees of knowledge and skill needed for these activities. Accord™ 
inglyi there has been an over-riding concern for individualization 
of instruction during the design phase of the project. This has 
resulted in a plan for a managment system for training which is 
described in Design Document III (DDIII), 

The proposed management system is essential to the individual 
focus of this project but has wider potential application. It is 
similar In conception to the instructional management system pre- 
sently in operation at Southwest State College. Indeed, project 
staff has participated in design work at that College and antici- 
pates that Consortium attainments will be closely integrated with 
the management of individualized Instruction at the undergraduate 
level. 

Based on DDIII, the Consortium proposed to develop and test 
an Instructional management system to include; 
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1) Data gathering instruments and procedures. 

2) Files for storing information related to in- 
structlcn process, training content and student 
behavior. 

3) Procedures and/or computer software for system 
implementation, 

4) Design and analysis of reinforcement practices 
used during training. 

5) Provisions for analysis of system outcomes and 
costs , 

Provisions for Delivery of Instruction 

The Conaoritum plans to meet immediate training needs of schools 
md industries in the region during the materials test phase of the 
project. While this training will be of Immediate benefit to educa- 
tional practice, it does not insure that organizational arrangements 
will exist for long-term delivery of needed training. Consequently, 
the Consortiimi proposes to test alternative delivery systems and, 
finally, to select the most suitable arrangement (s) for continuation 
of training in educational development and evaluation. Continuation, 
in this context, implies that financial support will be available not 
only for additional training, but for Identification of new training 
needs wid development of new and/or Improved instructional materials 
as well. 

Provisions for instruction delivery will be tested during Phase 
111 of the project. The following objectives express the outcomes 
of that testing: 
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1) Training site(s) for delivery of instruction. 

2) Practicum experience for trainees. 

3) Fee atructures adequate to meet continuation 
costs for training In educational development 
and evaluation, 

4) Articulation of training with credit and com- 
pensation practices In schools and industry. 

5) Recruitment practices to insure continued 
student input. 

6) Procedures for identification of new training 
needs . 

7) Training site staffing designCs) to Insure 
instruction development and Implementation, 

Project Evaluation 

The purpose of evaluation is to provide Consortium members with 
Information for making decisions. These decisions fall into two 
major categories: those related to the content of training offered 

and those involving training methodology, lach of the four objec- 
tives of the project (listed on p. 1 of this proposal) are focal 
points for evaluation activities. 

Objective 1, ’’A collection of training materials to meet iden- 
tified needs for persons with development and evaluation skills in 
education.", is the basic statement of project intent against which 
prograaa content must be evaluated. Since program content is ini- 
tially chosen to meet needs articulated by employers, there is close 
correspondence between personnel needs and training content at the 
outset of the project. Evaluation must therefore be primarily con- 
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cemed with providing Inforniation about developing training needs and 
with the degree to which training influences on-the-job performance 
of trainees. Two evaluation strategies seem appropriate for this 
objective I 

a) Status studies of educational development and evaluation; 

Periodic study of educational and industrial organiza- 
tions results in estimates of numbers of trained persons 
needed to fill jobs. Detailed analysis of job descriptions 
and the relationship between development and evaluation 
roles and organization goals identifies costs to new content 
evaluators provide essential Information for changes in pro- 
gram focus, 

b) Trainee follow-up studies; 

Longitudinal study of individual trainees gives infor- 
mation as to the kinds of tasks trainees perform on-the-job 
as well as indications of quality of performance. This is 
essentially a behavioral analysis problem; under what con- 
ditions do trainees engage in behaviors of which they have 
been trained? If trainees do not have opportunities to 
exercise their skills, program content should be altered. 

If, on the other hand, opportunities for action exist and 
trainee behavior is inadequate, training methods can be 
changed. 

Objective 3, "Trained personnel to meet the immediate needs of 
educational and industrial organizations,", is derived from Objective 
1. It refers more directly to the relationship between training and 

employer’s needs in the inaaediate service area of the Consortium. 

1 
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The evaluation of Objective 3 is basically a cost-effectiveness problem. 
The associated decision question is, ’Does the program provide locally 
needed training at equal or less cost to individuals and/or amployera 
than other training options?’. The project manpower survey (Design 
Document I) indicates a baseline of need for personnel with development 
and evaluation skills. If the program meets these needs in a cost- 
effective manner, a positive evaluation of Objective 3 is in order. 

Program management goals are suimnerized in Objective 2, "A system 
for data collection and decision making to manage the individualized 
instruction of persona in development and evaluation training programs,” 
This objective is detailed in Design Document III along with evaluation 
guidelines for determining attainment. Over-all evaluation of the pro- 
ject has the study of the management system as a component. 

Ivaluation of the attainment of Objective 4, "Arrangements for 
delivery and finance of training activities to meet long-term needs 
for pre- and in-service training in developmen an' evaluation.", is 
carried out in the market for education development and evaluation 
training. A positive evaluation of training delivery systems is 
found in the balance sheet of the training organization. The most 
suitable training design is that which meets Objectives 1, 2 and 3 
and can support training research and development as well as direct 
training costs entirely from purchased training. The various 
training delivery systems to be tested by the Consortium can be 
evaluated on this basis. 
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Part 3 - CONSORTIUM ORGANIZATION AND RESPONSIBILITIES 



The administrative organization of the Consortium is designed 
to insure m^imimi probability of attaining project objectives with- 
out binding the project to an inflexible structure. Accordingly, 
the administrative arrangements proposed in this paper are subject 
to evaluation by members of the Consortium and can be changed to 
alternate designs at any time. This potential for change is re- 
flected in the coordinate reaponsibllties depicted in the organl- 
zatioii chart below; 

Figure I 

Consoritum Organization 
and 

Project Responsibilities 




Program decisions are made by the Board. This Board Is com- 



prised of members of the project design staff, representatives of 
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school districts and representatives of training organizations. 

It is responsible for all new program directions and for employing 
the project director. Program governors deten.iine new auministra” 
tive arrangements for later phases of the project and approve 
budgetary decisions made by the Project Director. 

Upper Midwest Regional Educational Laboratory 

UMREL will serve the role of prime contractor for the Consortium. 

It will provide administrative and support services to project staff 
and will deal with all problems related to student recruitment, 
support and program evaluation. Project administration will Insure 
that subcontractors meet provisions of their contracts and that their 
respective efforts are coordinated and directed at project objectives. 
Through its administration of training, UMEEL will determine the most 
suitable organization for delivery of training. 

Educational Research and Development Council of the Twin Cities 

ERDC serves as an administrative mechanism whereby the contribu- 
tions of the Division of Educational Administration and Department of 
Psychological Foundations of the University of Minnesota can be obtained. 

ERDC also - through its representation of 44 school districts - provides 

an input of information as to neveds for training in area schools. 

Department of Psychological Foundations, Ucilverslty of Minnesota 

This Department will be primarily responsible for developing 
and testing training materials for education evaluation. Several 
members of this Department have participated In the design phase 
of the project, and will continue to give important service to 
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the project. Additionally, Psychological Foundations will provide 

one of the training options to be tested by the project. 

Division of Educational Admlnistrt lion, University of Minnesota 

The Division will design and te. t the instruction r 'nagement 
system for the Consortium. In addition to this work, the Division 
will assist IMRIL in carrying out necessary project evaluation 

studies. 

Control Data Corporation 

Staff members of CDC will develor and test instructional 
materials related to education develupment. This training will 
consist of currently available CDC materials, materials available 
from other suppliers and new materials to be developed. In 
addition to development activity, the Control Data Institute will 
serve as a test site for delivery of training to school and indus- 
trial personnel. Cost for such training would be borne by the 
Prime Contractor. 

Support personnel skilled in instruction development will be 

made available by CDC to those of the Consortium who are engaged 
in preparing training materials, CDC services will also be suppli 
to the Consortium for work on data files and other aspects of the 

instruction management system. 

Southwest State College, Marshall, Minnesota 

SWSC will be one of the test sites for delivery of training 

programs. It will supply opportunities for training to teachers 
in training as well as those educators presently in service. 

SWSC will also provide an opportunity to test features of the 
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Instruction management system and a baseline of information regarding 

schools against which the impact of the training effort can be 

i 

evaluated. 

State Departments of Education 

The five state departments of Education participating in the 

Consortium fill two major functions. They identify the content 

and scope of training needs which the Consortiim must confront. 

They also become sites for training and for practicum experiences 
for trainees in the later phases of the project. All five 
departments have contributed to an analysis of training needs 
during the design phase of the project and are planning active 
involvement as the project matures. 
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Part 5 - BtfDGlT SUMMRY (Totals by Project Year;^ 







6/71 


6/72 


6/73 


6/74 


1) 


UMREL 

Project Administration 


6,000 


18,000 


19,000 


20,000 




Support Sources 


2,500 


5,000 


5,500 


6,000 




Project Evaluation 




8,000 


9,000 


12,000 




Training Costs 




109,000 


82,000 


47,000 




Travel 


2,000 


2,000 


2,000 


4,000 




Subtotal 


10,500 


142,000 


117,500 


89,000 


2) 


IRDC 

Project Administration 


1,000 


4,000 


4,200 


4,400 




Secretarial 


2,500 


2,250 


2,250 


2,250 




Subtotal 


3,500 


6,250 


6,450 


6,650 


3) 


Psychological Foundations 
Salaries (Prof) 


6,500 


34,000 


43,000 


45,000 




Staff 


3,000 


10,000 


14,000 


14,000 




Support 


2,000 


10,000 


10,000 


5,000 




Materials 


5,000 


10,000 


5,000 


5,000 




Subtotal 


16,500 


64,000 


72,000 


69,000 


4) 


Educational Administration 
Salaries 


9,000 


18,000 


20,000 


22,000 




Secretary 


2,500 


5,000 


6,000 


6,000 




Materials 




2,000 


4,000 


4.000 




Subtotal 


11,500 


25,000 


30,000 


32,000 
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Control Data Corporation 

Materials Evaluation 


10,398 




(est . ) 

20,000 


Not 


Materials Development 


20,000 


97,841 


40,000 


available 


Pilot Testing 




13,864 




estimate 


Production 




15,317 


12,000 


approx. 


Consulting 


2,000 


3,600 


5,000 


73 level 


Stipends 

Subtotal 






20,000 




32,398 


130,622 


97,000 


90,000 


Southwest State College 
Staff 


3,750 


7,500 


8,000 


8,000 


Travel and per diem 


300 


500 


500 


500 


Subtotal 


4,250 


8,000 


8,500 


8,500 


Total 


78,648 


375,872 


331,450 


293,150 



SIMIAEY OF BUDGET DATA FROW ABOVE DATA 
FOR FIRST 18 MONTHS OF PROJECT 



Total to 6/71 $ 78,648 

To tsl to 6/72 $375f872 

Total Indirect Costs for first 18 months $ 32,030 

(Figure represents 8% times $400,374 for program 
development. Implementation, administration, and 
clerical salaries) 

Total Employee Benefits for first 18 months $ 54,854 

(19% times $288,703) 
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Total 



$541,404 
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SU^RY OF BUDGET DATA FROM 6022 FOK^S 
FOR FIRST 18 MONTHS OF PROJICT 



Special Training Projects 

Post-Doctoral Training 



Graduate Training 



Program Development 
[Figure includes 
implementation, 
personnel, plus 



all salaries for program development, 
project administration, and clerical 
Indirect costs and employee benefits.] 



$ 3,000 
$ 37,000 
$ 69,000 
$432,404 



Total $541,404 
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Part 6 - CONTRACTS 

Prime Contractort Upper Midwest Regional Educational Laboratory 

UMREL will undertake to provide administrative services, pro- 
ject support and study of training designs for the Consortium. It 
will; 

1) Administer all project funds and apportion 
said funds to subcontractors at its decretion. 

2) Provide office space and secretarial support 
services to the project. 

3) Recruit, compensate and evaluate the perfor- 
mance of trainees, 

4) Coordinate contributions of project subcon- 
tractors. 

5) Make summary evaluation studies and reports 
as indicated in the proposal. 





to 6/71 


6/72 


6/73 


6/74 


administration 


6,000 


18,000 


19,000 


20,000 


support services 


2,500 


5,000 


5,500 


6,000 


project evaluation 




8,000 


9,000 


12,000 


trainee costs 




109,000 


82,000 


47,000* 


travel and per diem 


2,000 


2.000 


2,000 


4,000 


Total 


10,500 


142,000 


117,500 


89,000 


* Post doctorate and 


graduate 


student 


support will 


continue , 



however, stipends for teachers and administrators will now 
become cost effective. 




VITA 



Willie Auimentorp 



ExperlanciB Background i 

9/67 - Director of Research*^ Upper Midwest Regional Educational 
Present Laboratory, 1640 East 78th Street, Minneapolis, Minnesota^ 

1/67 “ Executive Director*, Southern Minnesota Educational 
9/67 Research & Development Council, Coffman Building, Rochester 

Minnesota. 



1/65 - Dean of Men & Aasisitant Professor of Sociology, Carleton 
7/66 College, Northfleld, Minnesota. 

9/63 - Associate Director of Admissions & Instructor in Sociology, 
12/64 Carleton College, Northfleld, Minnesota. 

9/61 - Associate Director of Admissions, University of Chicago, 
8/63 Chicago, Chicago, Illinois, 

1/59 “ Admissions Counselor, Carleton College, Northfleld, 

8/60 Minnesota, 



*These positions were held in conjunction with present 
position as Associate Professor in Educational 
Administration at the University of Minnesota. 



Memberships in Professional Organizations i 

American Educational Research Association 
Association of Higher Education 
Phi Delta Kappa 

Twin City Operations Research Society 



Publications i 



1, Surveys and Reports i 

a. "Research in Program Planning." Upper Midwest Regional 
Educational Laboratory, May, 1968. 

b, "A Rationale for Teacher Education," Upper Midwest 
Regional Educational Laboratory, Novenier, 1968, 

2. Addresses and Papers: 

a. Address: Associated Colleges of the Midwest, Student 

Personnel Conference, Monmouth, Illinois, 1965. 
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b. Paper! 



c. Paper I 



'’Social Thought in Educational Adminis- 
tration," University’ Council for Educa- 
tional Administration, Columbus, Ohio, 
Spring, 1967. 

"Perspectives on Hianan Development." 
Brothers of the Christian Schools, Annual 
Conference, Adamstown, Maryland, Spring, 
1968. 



d. Paper: 



e. Paper: 



f. Address: 



er: 



"Social Organization for Special Education." 

U. S. Office of Education, Regional Confer- 
ence, Minneapolis, Minnesota, Spring, 1968, 

"Politics and Education," Claremont 
Graduate Seminar, Claremont, California, 

July, 1968. 

"Research on the Religious Life," Brother^ 
of the Christian Schools, National Conference, 
Joliet, Ilj.lnois, Sunmer, 1968. 

"Prerequisites for Systems Analysis." 

American Educational Research Association 
Symposium, Los Mgeles, California, February, 



3, Monographs, Books, Articles: 
a. Monog 



"A System for Inf orn* 3 ,tion Search and 
Retrieval." Upper Midwest Regional Educa- 
tional Laboratory, November, 1968. 



b. Monograph: 



Article: 



"A Format for Research and Development in 
Education." Upper Midwest Regional Educa- 
tional Laboratory, November, 1968, 

"Essay Review." Educational Administra- 
tion Quarterly, III , 3, Autumn, 1968, pp, 
85-89. 



d. Article! 



e. Book: 



"Prerequisites for Systems Analysis: 
ihialytic and Management Demands for a 
New Approach to Educational Administra- 
tion," With Marvin F. Daley and David 
N , Evans , Educational Technology , 
September, 1969, 

The Coi^tted , St. Mary's College Press, 
Winona, Minnesota, 1968, 



o 
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£, Book: "Social Perspectives on Religiouc Renewal." 

(Chapter) Approaches to Renewal (Washington, D. C,: 
Center for Applied Research on the 
Apostolate, 1970). 



g. Book: "Social Behavior and Administrator Train- 

(Chapter) ing." With Brian Fitch, The Social 

Sciences in Educational Administration , 

J, Culbertson (Ed), Columbus, Ohio, 
University Council for Educational 
Administration , 



4. Research Reports: 



a. "Diffusion of Innovation in Two Ethnic Groups." Un- 
published M.A, Paper (In Press), Department of Sociology, 
University of Chicago, 1963. 

b. "The Influence of Social Support in Decision Making," 
Unpublished Ph.D, Dissertation, College of Education, 
University of Chicago, 1964. 

c. "The Christian Brothers Study: Some Preliminary Find- 

ings," Brothers of the Christian Schools, Lewis College, 
Lockport, Illinois, 1968. 

d. School Finance in Southern Minnesota , with Dean E. 

Fritze, Southern Minnescta Educational Research & 
Development Council, Spring, 1968. 

e. Staffing Southern Minnesota Schools , with Dean E, 

FritEe, Southern Minnesota Educational Research & 
Development Council, Spring, 1968, 



Consulting Activities: 

1967- Consultant to Brothers of the Christian Schools - 
1968 National Study of Religious Life, 1967 (20 months). 



1968- Consultant to Minnesota State College Board - Design 

Present of a Teacher Education Program at Southwest Minnesota 
State College, Marshall, Minnesota. 

Summer,' Consultant to Upper Midwest Regional Educational 
1967 Laboratory. 



1967- Section Editor, Educational Administration Abstracts, 





Present 
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1967” Editorial Consultant^ Prentice-Hnlj. Publishing 

Present Company, Englewood Cliff, New Jersey, 

1968 Research Consultant to Instructional Simulation 

Incorporated, Macalester College, St. Paul, 
Minnesota. 
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VITA 



Geraldine Ann. Evans 

Education J 



1968 

1965 


University of Minnesota 

Ph.D., Educational Administration (emphasis in 
personnel administration), minor field - Educational 
Psychology, collateral field - Industrial Relations 

University of Minnesota 

M.A. , Educational Psychology (counseling emphasis) 


1960 


University of Minnesota 

B.S., Social Studies Education (sociology emphasis) 



Work Experiences 



1970 


Project Coordinator, RFP 70-12 Project, UMREL, 
Minneapolis, Minnesota 


1970 


Educational Consultant, Educational Programs, 
Minneapolis, Minnesota 


1969-70 


Educational Consultant, Educational Management 
Services, Inc., Minneapolis, Minnesota 


1967-68 


Research Assistant, Educational Research and Develop- 
ment Council, University of Minnesota, Minneapolis, 
Minnesota 


Summer, 

1966 


Personnel Consultant, Northwestern Bell Telephone 
Company, Minneapolis Office, Minneapolis, Minnesota 


Summer , 
1965 


Employment Counselor, United States Employment 
Service, Minneapolis Office, Minneapolis, Minnesota 


1963-66 


Secondary School Counselor, Anoka Public Schools, 
Anoka, Minnesota 


1960-62 


Secondary Teacher of Reading and Social Studies 
Hopkins Public Schools, Hopkins, Minnesota 



Consulting activities include negotiations, personnel 
administration, staffing and organizational problems, inservice 
training, staff attitude surveys, conununity attitude surveys, 
preparation of administrative manuals, organizing and publishing 
data and projections regarding manpower needs, wages, benefits, 
and other economic data. 
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Publlghed Works 5 



1. First-Line Supervision in the Public Schools (a monograph), 
Interstate Publishing Company, Danville , Illinois, March 
1968. 

2. Job Satisfaction and Teacher Militancy* Some Teacher 
Attitudes (a monograph with John M. Maas), Interstate 
Publishing Company, Danville, Illinois, 1969. 

3. Preparing the Negotiations Proposal and Background Materials 
for Negotiations (two manuals prepared for the Minnesota 
Federation of Teachers), Fall 1969, 

Educational Clerical Personnel , Educational Management 
Services, Inc., 151 Silver Lake Road, New Brighton, 

Minnesota 55112, January 1970. 

5. Griev .ice Procedures in the Educational Setting , Educational 
Management Services, Inc., 151 Silver Lake Road, New 
Brighton, Minnesota 55112, January 1970. 

6. Merit Pay for Teachers , Educational Management Services, 
Inc,, 151 Silver Lake Road, New Brighton, Minnesota 55112, 
January 1970, 

7 . Class Size and Numerical Staffing Adequacy , Educational 
Management Services, Inc, , 151 Silver Lake Road, New 
Brighton, Minnesota 55112, January 1970. 

8. "A Study of Teacher Negotiations,” The Minnesota Teacher, 
Winter 1969, Vol. XI, No. 2, pp. 14-17. 
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VITA 

David N . Evans 



Function; 

Mr, Evans sets Laboratory policies and procedures with 
the recommendations of the Board of Directors, and the 
Laboratory Coordinating Conanittee, He communicates the 
Laboratory program to USOE, to the Board of Directors, 
State Departments of Education, to the congressional 
delegation from the region, and to other audiences with- 
in the educational coBmunity. His responsibilities also 
include maintaining liaison with sources of nongovern- 
mental funding, and with other Laboratories and R & D 
centers. Additionally, he conducts yearly performance 
reviews of all staff members. 



Academic 



1958 



1962 



1966 



Background ; 

San Diego State College, Majur in Elementary Education, 
Minor in English, A.B. 

San Diego State College, Elementary School Administra- 
tion; Thesis on "Teachers Attitudes Toward Curriculum 
Development", M.A. 

Stanford University, Degree in General School Adminis- 
tration "Correlates of Educational Expenditures in 
Medium-Sized School Districts", Ed.D. 



Professloual Experience; 

July 1, Executive Director, Upper Mdwest Regional Educational 
1968- Laboratory, Minneapolis, Minnesota, 

Chief executive officer of a non-profit corporation. 
This corporation is managed by a 24-member board of 
directors. Chief functions have been to recruit a 
very able staff representing many different disciplines 
and then to provide them with an environment in which 
they can use their skills. Deals with representatives 
fron federal, state and local school districts. Con- 
tinue to pursue major professional interests in organ- 
izational theory, administration of research projects 
and educational finance. 




30 



-25- 



Laboratory policy and procedures j 

CoMnunicatlng lab program to USOE, Board of Directors p 
State Department of Education, Congressional delegation, 
and other audiences within educational community. 

Liaison with sources of private nongovernmental funding. 

All of recommendations of LCC in determining Laboratory 
policies . 

Yearly performance review of all staff members. 

Liaison with other Labs and R & D Centers. 

May 15, Research Director, State Conmittee on Public Education, 
1966-June Berkeley, California. 

1968 

Plan, organize, and direct education projects of major 
scopej reconmiend and develop methods of procedures for 
the collection and use of required project data; define 
the variables and limits of the project and evaluate 
basic factors influencing variations in the data; direct 
the analysis of data qualitatively, using the methods of 
the appropriate field of specialization; arrange for the 
effective use of special consultants, ad hoc task force 
teams, and other advisory services; plan and arrange 
meetings of advisory comnittees; direct the preparation 
of and personally present progress reports to advisory 
conmiittee; plan and provide leadership for regional meet 
ings and workshops to disseminate pertinent information 
or to provide in-service training; provide liaison be- 
: tween project co mmi ttees and interested persons and 
’groups; select, train, and evaluate project staff; 
coordinate and schedule project staff efforts and 
presentation of material developed; represent project 
staff at meetings and conferences; keep abreast of 
current developments in this specific field. 

Sep tern- Director Evaluation of the Impact of NDEA on California 
her 1965- Education, California State Department of Education. 

May 1966 

During this period I developed and administered a 
questionnaire designed to discover what impact the 
National Defense Education Act had on California 
Education. In the course of this study I traveled 
widely over the state, meeting with representatives 
of the 54 county departments of education that dis- 
tributed the questionnaire. I also organized and 
chaired a one week conference that coded the open 
ended response to the questionnaire and cooperated 
in the final writing of the report. 



o 
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June 1964- Research Assistant, Stanford University, School of 
June 1966 Education, Stanford, California. 



Served as project assistant to Professor James in this 
study of school finance. My major responsibility was to 
gather data on the City of Milwaukee. This study had 
two purposes; the first was to refine further the in- 
ductively-derived rationale for the study of school 
finance in which Professor J am es has been interested for 
a decade, the second was to apply the rationale to school 
systems in the great cities of the United States. 



Sep tern- Supervisor of Intern Teachers* San Diego Unified School 
bar 1963- District, San Diego, California, 

June 1964 

I had the responsibility of supervising five intern 
teachers . These teachers had no experience and it was 
my task to train them as elementary school teachers for 
the San Diego school system, I worl d cooperatively 
with San Diego State College in this task. 



February Instructor, San Diego State College Extension Division. 
1964- 

June 1964 Taught a class of thirty-five teachers on the topic 
"Modern Mathematics in the Elementary School", 



Sep tern- Teacher and Master Teacher, San Diego Unified School 
ber 1958- District, San Diego, California, 

Sep tem- 

ber 1963 I taught all subjects in a self-contained classroom in 
grades five and six and supervised student teachers . 
During two of these years I taught classes with children 
whose laQ.'s exceed 148 on a Stanford-Benet Intelligence 
Test. During the last year I also served as the sub- 
stitute principal for the Rchool . 



Publications i 

1 , The Impact in California of NDEA i Titles III , ^ and VIXI . 

2, Correlates of Educational Expenditures in Medium-Sized School 
Districts . 

3, Correlates of Educational Expenditures in Medium-Sized School 
Districts (abstract to be published by N.E.A, as one of the 
papers given an award by 10th National Conference of School 
Finance) . 

4, Off With the Handcuffs ; The State Conmittee on Public Education’s 
plan for freeing schools, (Presented at 1967 Ca3.ifornia 
Association for School Administrators Conference) . 

er|c 
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5. Abstract of Citizens for 21st Century (submitter to ^erlcan 
Educational Research Association) , 

6. Evans j David N. and Potter, Conrad H, "Correlatea of 
Educational Expenditures in Medium-Sized School Districts; 
r acational Expenditures in Large City School Districts, 

1950-60 . " The Challenge of Change in School Finance , 
Washington, D. C., National Education Association, 1967, 
pp. 204-210. 

7. Guthrie. James W., Penfleld, Douglas and Ivans, David N. 
"Geographic Distribution of Teaching Talent in California, " 
Citizens for the 21st Century - Long-Range Considerations 

for California Elementary md Secondary Education , Sacramento, 
California, California State Comnittee on Public Education, 

1969, pp. 203-222. 

8. Evans s David N. "Teacher Preparation, a Special Concern." 
Citizens for the 21st Century - Long-Range Considerations 

for California Elementary and Secondary Educ ation , Sacramento, 
California, California State Conmilttee on Public Education, 

1969, pp. 223-229. 

9. Guthrie, James W,, Penfleld, Douglas A. and Evans, David N, 
"Geographic Distribution of Teaching Talent," Merlrgg 
Education Research Journal , ^(4), pp. 645-659, November 1969. 

10, Ammentorp, William M. , Daley, Marvin F, and Evans, David N. 
"Pre-requisites for Systems Analysis in Education," 

Behavi orally Engineered Environments - Staff Papers for AEM 
Symposlma , 1970 , Minneapolis, Minnesota, Upper Midwest Regional 
Educational Laboratory, 1970, pp, 41-42, 

11, Honetschlager, Dean A, fuid Evms, David N. "Establishing 
Relationships for Research-Based Development in Schools." 
Behavlorally Engineered En vi r onmen t s - Staff Papers for AERA 
Symposium , 1970 , Minneapolis, Minnesota, Upper Midwest Regional 
Educational Laboratory, 1970, pp, 45-47. 

12, Evans, David N. "Directions for the Seventies." Needs of 
Elementary md Secondary Education for the Seventies , 

Washington, D. C., General SubcoBmlttee on Education of the 
Coimnittee on Education and Labor, House of Representatives 
Ninety-First Congress, 1970, pp. 183-186, 

33. Evans, David N, and Johnson, I. T. The Impact in California 

of NDEA Titles III , V, VIII . Sacramento, California, California 
State Department of Education, 1967, 
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Froffessional Affiliations : 



American Association of School Administrator 
American Educational Research Association 

National Education Association 
Phi Delta Kappa 
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VITA 

Jon R. Morrlfe, Program Coordinator, UMREL 



Function i 



Mr. Morris’ responsibilities are in two major areas; (a) designing 
and carrying out research on conditions in the UMREL school environment 

with a goal of validating existing educational designs and suggesting 
new ones and (b) advising graduate students both in programs of study 
and in dissertation research related to the Laboratory program. 



Academic Background ; 

1963 B.S., Major-Mathematics, Physics 

Illinois Wesleyan University 
Bloomington, Illinois 
1965 M.A. , Mathematics 

University of Denver 

1970 Ph.D., Major-Experimental Design, Statistics, 

Computer Applications in the Behavioral Sciences, 

University of Colorado 



Professional Experience ; 

1964- 65 Instructor, Part-time, Temple Buell College, 

Denver 

1965- 67 Programmer-Modeler, McDonnell Automation Company, 

St. Louis. System design, programming, and debugging 
of utility routines for the Gemini A trainer software 
system. Analyzed, designed, and Implemented the 
aerodynamic data package for a commercial Jet pilot 
trainer. Did considerable anaylsis of the post 
simulation data to verify the accuracy of the simulation 
technique, 

1966- 67 Instructor, Part-time, University of Missouri, St. Louis 

Instructed two classes of Introduction to Digital Programming. 

1967- 68 Director of Data Processing and Instructor of Mathematics, 

Wisconsin State University, Stevens Point. Duties were 
preparation of operational philosophy of the department, 
conduct a program of information and assistance to various 
areas of the university such as academic affairs, business 
affairs, library and student affairs as to the potential 
of the available equipment. Develop and maintain useful 
data systems for all areas of the university. Preparation 
and execution of the department budget. Supervision of 
personnel consisting of one programmer and three data 
preparation persons. Establish priority of use schedules. 
Furnish programming support as required by faculty members. 
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Professional Experience Continued ; 



1968 - 



1968 - 



Ins truct one class in computer programming. Developed 
teletype interlink with University of Wisconsin Computer 

Center at Madison. 

Internship experience through the Laboratory of Educational 
Research, University of Colorado. 

(1) Colorado State Department of Education Urban Planning 
Division. Implementation of SCANPED (System for 
Comparative Analys s of Programs for Educational 
Development) on the computer at University of Colorado. 
Consulted on appropriate regression techniques for 
projection, conversion of the program from a foreign 
machine and some debugging of the program. 

( 2 ) Applications of the following data analysis techniques: 
Regression analysis, ANOVA, MANOVA, MAMCOVA, discriminate 
function analysis, factor analysis, multivariate 
analysis of repeated measures, and canonical corre- 
lation analysis in actual experimental setting, 
including preparation for computer analysis , inter- 
pretation of results, and writing of final report. 

As a laboratory fellow a considerable amount of time 
is given to consultation on experlmeri al design to 
clients (including faculty and students) from various 
departments of the university. 

(3) Consultant for computer usage and data analysis of 
Compensatory Education Act (Title I) evaluation. 

(4) Design and programing of two interactive mode programs 

for the C.D.C. 6400 Scope 282 graphics system. 

Programs are The Tape Editor and The University 

Planner. 

Graduate Assistant, WICHE-MIS. Assignments have included: 
Conducting a review of the literature on Student Flow 
Models (Student flows as related to resource requirements 
predictions for higher education) . Preparation of a 
report outlining the aims of the WICHE Student Flow Model 
including a schema for evaluating various prediction models 
using as test data historical data from the University 
of Colorado. Preparation of data tapes including six 
years of crossover data (by major by student) which can 
be matched with student entrance data, diploma card data, 
and instructional characteristics files. These tapes will 
be used for model evaluation. Preparation of crossover 
matrices, matched with characteristics data to be analyzed 
for structural components of student behavior (see research 
papers in progress) , 
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Professlonal Affiliations : 

American Educational Research Association 
National Council on Measurement in Education 

Association for Computing Machinery 
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Subcontracts and Letters of Coimnltment 



The budget summary on page 14 is derived from the following 
documents. Each expresses the subcontractor’s intent to attain 

certain project objectives. The reader’s attention is drawn to: 



a) Objectives to be attained. 

b) Dollar amounts by project year. 

c) Staff qualifications, 

d) Letters of comnitment. 
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Subcontractor #1; Educational Research and Development Council 



The Educational Research and Development Council will provide 

administrative and coordination services tc the Consortium. It 

will be the administrative agency for involvement of the Department 
of Psychological Foundations and the Div ion of Educational 
Administration of the University of Minnesota. The detailed budgets 
appended to the subcontracts of these participants will be managed 

by ERDC. 

A person from the ERDC staff will be assigned to the project 

and will assure coordination of work done by University staff. 

ERDC will also provide office space and secretarial services as 
necessary for contract administration. 

Subcontract Budget; 



ERDC 


6/71 


6/72 


6/73 


6/74 


Project administration 
(%FTE) 


$1,000 


$4,000 


$4,200 


$4,400 


Secretarial (JjFTE) 


$2,500 


$2,250 


$2,250 


$2,250 


Total 


$3,500 


$6,250 


$6,450 


$6,650 





‘i.* . ' i * ■ ' . I } I '■V* M 

251 HEALTH SERVICE BLDa 
UNIVERSITY OF MINNESOTA 
ST. PAUL, MINNESOTA 55101 

EDUCATIONAL RESEARCH and DEVELOP ME»\‘ 

of the Twin Cities Metropolitan Area, Inc. 

COLLEGE OF EDUCATION 
UNIVERSITY OF MINNESOTA 
MINNEAPOLIS, MINNESOTA 55455 



r U N G I L 



AREA CODE; 612 
373-4872 
373-4860 



Activi Mambersi 
Anoka 

Belle Plaine 
Bloemi niton 
Brooklyn Center 
Burnsville 
Centennial 
Chaska 

Columbia Heights 
Eden Prairie 
Edina 

Farmington 
Forest Lake 
Fridley 

Golden Valley 
Hopkins 

Inver Grove-Pine Bend 

Lakeville 

Mahtomedi 

Minneapolis 

Minnetonka 

Mound 

Mounds View 

New Prague 

No. St, Paul-Maplewood 

Orono 

Oiseo 

Prior Lake 

Richfield 

Robbinsdaie 

Rosemount 

Roievllle 

St. Anthony 

St. Francis 

St. Louis Park 

St. Paul 

Shakopee 

Spring Lake Park 

Stillwater 

Waconia 

Watertown 

Wayzata 

West St. Paul 

White Biar Lake 

Associate Members; 

Afohd i ooooQ^ofi 
A4tfweapoiisitSt." Rauf 
Delano Public Schools 
Rockford Public Schools 



O 
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Dr, John Egernieier, Acting Chief 
Research Training Branch 
National Center for Education, 

Research and Evaluation 
U. S. Office of Education 
400 Maryland Avenue S. W, 

Washington, D, C. 20202 

Dear Dr, Igermeiers 

The Educational Research and Development Council of the Twin Cities 
Metropolitan Area represents 44 school districts in the seven county 
Miniieapolis-St, Paul metropolitan area. This consortium of schools 
is extremely interested in, and wholeheartedly supports, the pro- 
posal to Initiate a Midwest Educational Training Center t«. train 
educational developers and evaluators. 

Many problems and needs exist on the educational scene today, but 
par^ount among problems and needs is the need to prepare people 
in the area of: program development and evaluation. To accomplish 
this, a carefully designed program of inservice training is needed 
to train such personnel. 

The Board of Directors of the Educational Research and Development 
Council of the Twin Cities Metropolitan Area enthusiastically 
endorses the aforementioned training project and would willingly 
assume a sub or prime contract to foirward the effort. 

Most sincerely yours. 



Thomas F, Stark 
Executive Secretary 

TFS/rrr 
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cci Wayne W. Welch 



Subcontractor #2; Division of Educational Administration 

University of Minnesota 



The Division of Educational Administration proposes to design 

and test an Instructional management system for the Consortium, 

This system will meet the objectives outlined for individualized 

instruction in Design Document III, namely, 

”1. The goals of learnDig are specified in terms of 

observable behavior and the conditions under which 

this behavior is to be exercised . 

2. Diagnosis is made of the initial capabilities with 
which the learner begins a particular course of 
instruction. The capabilities that are assessed 

are those relevant to the forthcoming instruction. 

3. Educational alternatives adaptive to the initial 
profile of the student are presented to him. The 
student selects or is assigned one of these alter- 
natives . 

4. Student performance is monitored and continuously 
assessed as the student proceeds to learn. 

5. Instruction proceeds as a function of the rela- 
tionship between measures of student performance, 

available instructional alternatives and criteria 
of competence. 

6. As Instruction proceeds, data is generated for 

monitoring and improving the instructional system. 

7. Knowledge and skills available tc trainees are 

modular in nature and can be aggregated to meet 
demands of particular employee roles. 

8. Follow-up data on trainee performance on the job 
is gathered and used to revise and update training 
program content, 

9. Students may enter and leave the program at any 
point. Enter/leave decisions are controlled by 

trainee characteristics and desired skill /knowledge 
outcomes. 

10. Certification and/or credit is an optional feature 
of the program. Decision rules are available to 

insure wide interpretation of program content across 
receiving organizations. 



11. Student performance - both during and subsequent 

to training - constitutes the dat"^ source for pro- 
gram evaluation. It also produces a baseline of 
performance against which Instructional innovations 
can be judged." 

\ 

Divisional staff assigned to the project will design and test a 

system to meet the above objectives. The outcomes of their work 

will be those outlined on page 3 of the Consortium proposal J 

a) Data gathering Instruments and procedures 

b) Files for storing information related to instruc- 
tion process, training content and student behavior. 

c) Procedures and/or computer software for system 
imp lemen t a t i on . 

d) Design and analyses of reinforcement practices 
used during training. 

e) Provisions for analysis of system outcouies and 
costs . 

To this listing will be added reports of system features and 

evaluation of Implementation testing of the management system. 

Budget : 





6/71 


6/72 


6/73 


6/74 


Staff: 


Assoc. Prof. (^sFTE) 


$4,000 


8,000 


9,000 


10,000 


V. HendriK (JsFTE) 


$5,000 


10,000 


11,000 


12,000 


Secretarial (1 FTE) 


$2,500 


5,000 


6,000 


6,000 


Materials and 


Computer Time 




2,000 


4,000 


4,000 


Total 


$11,500 


25,000 


30,000 


32,000 
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division OF EDUCATIONAL ADMINISTRATION 
203 BURTON HALL • MINNEAPOLIS, MINNESOTA 554S5 



Decer-.ber 1, 1970 



!■>. John Egerr.eier 

Actinr; Ghief 

Resecrcl. TrEining 3rE.neh 

U* S, Cfiioe of Educp.tion 
4CC Rerylind Avenue S.V.'.* 
Hooci ^ChO 

\vashin£:ton^ C. C. 20202 

Bear Mr. Egeri^eieri 



The Ei Vi Sion of Educe tional Adsini strr tion is pleased to offer 
its assui'ance that the attached subcontract vdll receive high 
priority in H. vision efforts. Staff sen-.bers nar.ed in the con tract 
v;ill be proportionately relieved of Ei visional resvonsi bil ' ties 
and given the cocplete support of Eivision staff ss they carry out 
this important Kork. 

The Division’s interest in now designs for ii.struction end 
special training to meet educstionnl needs is one of long standing. 

I hope that this project vdll be an important step in Eivision effort 

to serve the educstionrl needs of the region. 

[ji-lu4 

hcoker 



CIHshs 
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VITA 

Vernon L. Hendrix 



Present Position; 

Professor, Division of Educational Administration, 

College of Education, University of Minnesota. 



Recently - 1967-69: 

Assistant to the Chancellor for Research and Training, 
Dallas County Junior College District. 

Education; 

B.M. from Texas Christian University, Music - History - 
Composition , 

M,M, from University of Texas, Musicology, 

1962 Ph.D., from UniversiLy of Texas, in Junior College 

Administration. 



Special Interests; 



Institutional Research 

Administrative Decision-Making 

Computer Usage in Administration 

Systems Analysis in Educational Institutions 



Teaching; 

Junior College Administration and Institutional 
Research, University of California, Los Angeles . 

Humanities, Music History and Theory, Pensacola 
Junior College, Pensacola, Florida, 

Adminis tration ; 



Assistant Dean, College of Fine Arts, University of 

Texas . 
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Member I 



American Association of Junior Colleges 
Association for Higher Education 
American Educational Research Association 
Association for Institutional Research 
Association for Computing Machinery 



Current Activities: 



Teaching and supervising research in the 
area of administration ■ — Higher Education, 



Papers and 



Reports : 



1 . Environmental Measurements in Educational Institutions » 
National Conference of Professors of Educational Adminis- 
tration , New York University, August, 1964, 



2. Systematized Institutional Research , National Conference 
of Pro£esso''a of Educational Administration, New York 
University, August, 1964. 

3. Population Age Distributions and Public Education 
Expenditures , (with Marvin C, Aiken) American Educational 
Research Association, New York, February, 1967, 



4. Research Opportunities in Comprehensive Public Junior 
Colleges I Inter- and Intra-College Organizational 
Problems , ^erican Educational Research Association, 

New Y T rk , Feb ruary , 1967. 

5 . Community Characteristics Related to Perceived Student 
Satisfaction aid Achievement in 100 Public Junior 
Colleges . Mierican Educational Research Association, 

Los Angeles, February, 1969, 

6 . Environmenta l Determinants of Successful Occupational 
Iralnlng in Pviblic Junior Colleges , ^erican Education 
Research Association, Minneapolis, March, 1970. (Partial 
report of HRli-117-65) . 

7. College Environments and Student Change Mechanism in 
Public Junior Colleges , American Personnel and Guidance 
Association, New Orleans, March, 1970, (Partial report 
of HM)-117-65). 
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Publications : 



1 • Manual for the Prepar at ion of Dissertation Research Pro- 
posals ! Los Angeles j Junior College Leadership Program, 
Universit of California, 1963. 

2. "Academic Rank: Mostly Peril?" Junior College Journal. 

34, #4:28-30, December, 1963. 

3. "An Iterative Solution of the Normal Probability Integral," 

Educational and Psychological Measurement , 24, #3:663-667, 
Fall, i96'4. ■ - 

4. "Emerging Dimensions in Junior College Environments," 
Institutional Research in the Junior College , A Report 

of a Conference Sponsored by the University of California, 

Los Angeles, Junior College Leaders’ilp Program and the 
Southern California Junior College Institutional Research 
Group, Los Angeles: School of Education, U.C.L.A., 

September, 1964, pp. 21-28. 

5. "Rationale and Potential for Environmental Measurement in 
the Junior College," Institutional Research in the Junior 
College , A Report of a Conference Sponsored by the University 
of California, Los Angeles, Junior College Leadership Program 
and the Southern California Junior College Institutional 
Research Group, Los Angeles; School of Education. U.C.L.A. , 
September, 1964, pp, 1-16, 

6. "Relationships Between Personnel Policies and Faculty Life- 
Record Data in Public Junior Colleges," California Journal 
of Educational Research , 15, #3:150-157, 160, May, 1964. 

7. "Relationships Between Personnel Policies and Faculty 

Personality Characteristics," California Journal of 
Educational Research , 15, #1:34-43, January, 1964. 

b, "Academic Personnel Policies and Student Environmental 
Perceptions," Educational Administration Quarterly , 1, 

#1:32-41, Winter, 19 6T. 

9. "Academic Rank Revisited," Junior College Journal , 35, 

#5:24-28, February, 1965, 

10. "Administrative Research in Educational Systems," in A 
Conceptual Framework for Institutional Research , Pro- 
ceedings of Fourth Annual National Institutional Research 
Fjrum, Washington State University, Pullman, Washington, 

1965 (Conference at University of Minnesota) pp. 17-22. 
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11. "Inatltutlonal Research in Junior Colleges,-' in A Concep- 

ual Framework for Institutional Research , Proceedings of 
Fourth Annual National Institutional Research Forxjm, 
Washington State University, Pullman, Washington, 1965, 
(Conference at University of Minnesota), pp , 67-82, 

12. "The Blacky Test: Another Approach to Factor Analytic 

Validity," (with Sandra Robinson) Journal of Projective 
Techniques . 

13. "Environmental Press Preferences of Students," in Research 

on Academic Input , Proceedings of Sixth Annual Forum of 
the Association for Institutional Research, State University 

of New York College at Cortland, Cortland, New York, 1966. 
(Conference in Boston), pp, 189-193. 

14. "Input-Output Relationships," in Financing Junior Colleges 
in California , (with Marvin C. Aiken) Sacramento: 

California State Department of Education, 1966, pp. 34-40, 

15 . Functional Relationships of Junior Colleges Environments 

and Selected Characteristics of Faculties, Students, the 
Administration and the Community , Minneapolis: University 

of Minnesota (Final Report of Cooperative Research Project 
#2849), 1967. 

16 . Input-Output Relationships in a Sample of California Public 
Junior Colleges" (with\ Marvin C. Aiken) Los Angeles; Center 

for the Study of Evaluation in Instructional Programs, 
University of California, 1967. 

17. "Factor Dimensions and Reliability of the Work Values 
Inventory," (with Donald E. Super) Vocational Guii.dance 
Quarterly , June, 1968, pp, 269-274, 

18. "A Professional Library for Junior Colleges," (with Kenneth 

Costing) Minneapolis: University of Minnesota, 1967. 20 

pp. 

19. "Junior College Environment Scales," in Institutional 

Research and Academic Outcomes , Proceedings of the Eighth 
Annual Forum on Institutional Research, University of 

Georgia: Atlanta, 1968. (Conference in San Francisco), 

pp . 61-72. 



Reviews : 



1. Schick, Thomas, "Disk File Sorting." Comm. AC M, 6,6 
(June, 1963), 330-331. 



o 

ERIC 



47 



-42- 



2. Berkshire, James R., "Human Quality Control." Proceedings 4th 

IBM Medical Symposium., October, 1962, Endicott, N. Y,, 355- 

370.“ 

3. Bushnell, Donald D. , "The Role of the Computer in Future 
Instructional Systems." AV Communication Review, Supplement 7 

(March - April, 1963), 70p. 

4. Egbert, Robert L., "The Computer in Education: Malefactor or 

Benefactor," Proceedings AFIPS 1963 Fall Joint Computer Confer - 
ence , Las Vegas, Nev. , November 1963, 619-630. Spartan Books, 

Baltimore, Maryland. 

5. Kish, Leslie, "Survey Sauipling," John Wiley & Sons, New York, 

1965, 643 p. 

6. Kuehn, Alfred A.' and Weiss, Doyle, L. , "Marketing Analysis 
Training Exercise." Behavioral Science , 10, 1 (Jan. 1965), 51-67. 

7. Personnel Reports — a CBS Special," Business Automation , 12, 3 
(March 1965), 51-53. 

8. "Using Programs to Teach Programming Skills," Business Automation , 

11, 7" (July 1964), 32-35. 

9. Boullet, L., "An Example of Computer Use for Mass Processing, 

Aiming at Maximum Profitability." In Economics of Automatic 
Data Processing , 259-267. 

10. Braudo , M. , "Automation with a Provident Fund Employing An 

ADP Service Center." In Economics of Automatic Data Processing , 
248-258. 

11. Fdwards, Ward, "Optimal Strategies for Seeking Information: 

Models for Statistics, Choice Reaction Times, and Human 

Information Processing," Journal Mathematical Psychology , 

2, 2 (July 1965), 312-329 " 

12. Greene, R. H. , "Adapting Audit Techniques Under Automation," 

Audit gram , 41, 11 (November 1965), 12-14. 

13. Hiltz, F. F., "Computer Correlation Analysis of Intracellular 

Neuronal ResponseF’. " In Proceedings AFIPS 1965 Fall Joint 
Computer Conference , Part I, 567-581. 

14. Porter, Than R. , "Parameter Reading Routine for Statistical Lib 
Library Programs." Presented at Metropolitan New York ACM 

Symposium, New York City, March 1966. University Computer 
Center, New York University, 15 p. 
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15. Sprowls, R. C., ’'Economic Analysis of Telepro'-'sssing Service 

at the Western Data Processing Center," Economies of Auto- 
matic Data Processing ^ 268-276, 

16. Thlbert, R. ^ "Bookkeeping by Computerj Using an Optical 
Reading Device," Economics of Automatic Data Processing, 

277-281. 

17. Zucker, M. S,j "LOCSj An EDP Machine Logic and Control 
Simulator." IEEE Trans . , Ec“14j 3 (June 1965), 403-416. 

18. Ball, Geoffrey H. , and Hall, David, J., "A Clustering 
Technique for Sununarizing Multivariate Data." Beh^vixjral 

Science , 12, 2 (March 1967), 153-155. 

19. Cello, Rinaldo Baldlni, "A Study of the Cyclic Use of the 
Same Central Unit by Many Customers." ICC Bulletin , 6, 1 
(January-March 1967), 27-38. 

20. "Description of Systems Used for Data Transmission (an ASA 

Tutorial)," Comm. ACM, 9, 10 (October 1966), 764-770, 

21. Maloney, Clifford J,, "Multinomial Acceptance Sampling." 

Proceedings ACM 21st National Conference , 445-452. 

22. Menkhaus, Edward J., "Film Stars in Action-Packed File 
System." Business Automation , 14, 4 (April 1967), 40-44. 

23. Shapiro, S., "A Technique to Control Waiting Time in a 
Queue." IBM Systems Jouriial , 4, 1 (1965), 53-57. 

24. Wendler, Charles Clifford, "Total Systems — Characteristics 

and Implementation." Systems and Procedures Association, 
Cleveland, Ohio, 1966, 123 pp. 
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Subcontractor #3i The Depa^-tment of Psychological Foundations 



Components to be fumisutU; 



I. A listing of the responsibilities of the department. 

II, A time line of the activities 

III. Summary table of the evaluation training planned. 

IV. Budget estimate and summary. 

V. List of identified evaluation hierarchies and estimate of 
availabijjity of modules. The components of these modules 
are keyed to the list of objectives in the conceptual 

papers . 

VI, k sample training module. 



The Department of Psychological Foundations of the College of 
Education, University of Minnesota agrees to the following 
responsibilities as a subcontractor for the Midwest Educational 

Training Center. 

1, Develop a set of evaluation training modules to achieve the 
instructional objectives identified in the area of evalua- 
tion, The modules will be developed for each of the 12 
levels of evaluatlcn skills Identified in the conceptual 
paper by Welch found in Design Document II. The hierarchy 
of the evaluation skills is reproduced in Part V of this 
agreement, together with an example of the form and format 
of a training module. (See Part VI). Current plans call 
for the development of six of the modules during the first 
year of the implementation stage, and the remaining six to 
be developed during the following year. (See schedule in 
Part V). 

2. Provide training and/or retraining in the area of evaluation 
for two post-doctoral fellows for each of three year of the 
implementation stage. The training will consist partially 
of intern or practlcum experience in the development of the 
training modules, collaboration with staff currently working 
on evaluation problems, and participation in the actual 
training experience to be provided to others. 



(Note) 
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3. Provide yearlv training opportunities for ten graduate 
fellows in the area of research and evaluation. Special 
emphasis will be given to practicum experience in develop- 
ment, training, and actual evaluation experiences. The 
role expectation for those students is an evaluation 
specialist. This is listed as Role B in Figure 2. 

Provide training for 20 evaluatiou specialists currently 
functioning in educational institutions. The initial 
training focus wil± be on pilot testing and researching 
the training modules. In subsequent years, the focus 

shift toward increased training opportunities. Anti- 
cipated numbers of specialists to 3 trained is 40 per year. 

■5 • Train and/or retrain a total of 100 classroom teaclars in 

the set of skills identified essential for their role. The 

levels of objectifies considered here are specified in Figure 1. 

6. Train 20 school administrators or other central office 

personnel (for example, state department, junior college, 
school districts) in the identified research and 
evalua '''on skills. 

II. A time line of activity planned for the department is shown in 
Figure 1. The period shown extends to September 1972. We 

expect that the cycle will be repeated during subsequent years. 
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Notice that the initial emphasis is on development but gradually 

shifting toward more training. 



(Note) III. An overall summary of the evaluation training planned, the target 

role to be filled, and estimated numbers of trainees is shown in 

Figure 2. 
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IV. BUDGET SUMMARY 



February - June 30, 1971 

Salaries 

Stipends 

Staff 

Support 

Materials 

Subtotal 



July 1, 1971 - June 30, 1972 

Salaries 

Stipends 

Staff 

Support 

Materials 

Subtotal 



July 1, 1972 - June 30, 1973 

Salaries 

Staff 

Support 

Clerical 

Subtotal 



July 1, 1973 - June 30, 1974 

Salaries 

Staff 

Support 

Clerica.'^ 

Subtotal 



6,500 

(See prime contractor budget) 

3.000 

2.000 

5,000 

16,500 



34.000 

(See prime contractor budget) 

10.000 

10,000 

10,000 

64,000 



43.000 

14.000 

10.000 
5,000 

72,000 



45.000 

14.000 
5,000 
5,000 

69.000 
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ITEMIZED BUDGET FOR FIRST TWO YEARS 
Specific coiimiittnents and estiinated costs 



Feb, 18 - June 30, 1971 


Rhetts (c) 


Planning , 


$ 


2,000 


Travel 


$ 


2,000 


(4 months) 


Johnson (%) 


recruiting 




2,000 


Materials 




5,000 




Welch (%) 






Mlsc, 




2,000 




$1500 through 




$ 


4,000 


Secretary 




1,000 




UMREL 










$ 


10,000 


June 30 - Sept. 30, 1971 


Rhetts (is) 


Deve lop 


$ 


3,000 


Secretary 


$ 


2,000 


(3 months) 


Johnson (c) 


training 




2,000 


Materials 




5,000 




Welch % (c) 


packages 




2,000 


Misc. 




5,000 




Post “doc. (2) 






8,000* 










Asst. Prof. (1) 






4,000 




A 


12,000 




Terwilllger Qf) 




$ 


19,000 








Sept. 30 - June 30, 1972 


Welch (%) 


Pilot 


$ 


4,000 


Materials 


$ 


5,000 


(9 months) 


Johnson (%) 


training 




4,000 


Stipends (20) 




5,000* 




Rhetts (k) 


development 




3,000 


Staff (2) 




8,000 




Asst. Prof, (1) 






12,000 


Misc. 




5,000 




Post-doc. (2) 






24,000 










Grad, Students (4) 






12,000 




$ 


23,000 








$ 


59,000 












Subtotals 


$ 


82,000 




$ 


45,000 


June 30 - Sept, 30, 1972 


Post-doc. (2) 


Training 


$ 


8,000* 


Stipends (120) 


$ 


30,000 


(3 months) 


Prcfessor (4) 






20,000 


Staff (2) 




6,000 




Grad. Students (4) 






3,000* 


Misc. 




5,000 








$ 


23,000 




$ 


41,000 






TOTAL 


$ 


105,000 




$ 


86,000 



* Stipends to UMRIL as prime contractor. 
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VITA 

Roger A. Raymond 



Education: 



1949 - 1951 B.A. University of South Dakota (Experimental 

Psychology) 

1953 - 1954 M.A. University of South Dakota (Experimental 

Psychology) 

Other Educational Attendance: 



Angus tana College 
Sioux Palls College 
IBM Training Center 
CDC Management Education 
PRAXIS Corporation 

Professional Experience : 

8/70 - present Southwest State College - Associate Director 

of the Higher Education Coordinating Committee 

6/70—7/70 Control Data Corporation — Manager, Advanced 

Development CDEI 

3/69 — 5/70 Control Data Corporation — Manager, Curriculum 

Development CDI/CT 



1955 - 1969 



1954 - 1955 



Sioux Falls Public Schools - Teacher Guidance 
Counselor Research Assistant Testing Coordinator 
Special Services Assistant 

Jefferson City College - Instructor, Psychology 



Honors : 



1953 - 1954 



Graduate Assistant — Experimental Psychology 
University of South Dakota 



1964 Attendance at USOE sponsored practicum in guidance 

and counseling. University of South Dakota School 
of Education 



O 



W:^ Iting : 



M. A. Thesis - Size Judgments As A Function Of The Ames Monocular 

Distorted Room 

iiB 
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Wrltlng (continued) 



Teaching Algebra to Ninth and Tenth Grade Students 
with the use of Programmed Materials and Teaching 
Machines 

A Consideration of Teaching Machines and Programmed 
Materials with Individualized Student Programs in 
Small Groups 

Third Grade Reading Instruction as a Function of Team 
Teaching vs. Single Teacher Method 

Teaching Reading to Sixth Grade Pupils with the use 
of Science Research Associates Reading Laboratory 
Materials 

A Consideration of Homogeneous Grouping of Fifth 
Grade Students 




112 



Appendix I 
Letters of Support 



A 




118 
















-113- 



university OF 






COLLEGE OF EDUCATION • MINNEAPOLIS, MINNESOTA 55455 



OfSee of ihe Dean 



Deceniber 8, 1970 



Dr. John C. Egermeier, Chief 
Research Training Branch 
National Center for Educational 
Research and Development 
Room 3051 

400 Maryland Avenue S.W. 

Washington, D.C. 20202 

Dear Dr. Egermeier:. 

I should like to express my strong support to the proposed 
Midwest Educational Training Ce.'iter being dev^oped under the auspices 
of the Upper Midwest Regional Educational Laboratory. The heed for 
training educational development and evaluation personnel is extremely 
great in the tipper midwest region. The proposed Center offers 
flexibility and the opportunity for training at all levels of the 
educational profession. 

I have closely followed the work of the consortium and pledge the 
support of the College of Education for this activity. The performance-?' 
based model for training development and ev^uation personnel proposed is 
one worthy of continued study and research. Because our College is 
always receptive to new ideas, we are actively encouraging programs 
involving a nuniber of different agencies in our attempt to continually 
improve educational training. 



Sincerely yours. 







JCM/bln 




ERIC 



UNIVERSITY C 




STUDENT COUNSELING BUREAU 
101 EDDY HALL • MINNEAPOLIS, MINNESOTA 55455 



December 11, 1970 



Dr. John C. Egermeier 
Acting Chief 
Research Training Branch 
National Center for Education, Research, 
and Development 
U. S. Office of Education 
400 Maryland Avenue Southwest 
Washington, D. C. 20202 

Dear Dr. Egermeier: 

I have been asked to comment on the Midwest Educational Training Center proposal 
for the formation of a consorituin to train personnel qualified to evaluate 
educational programs. In my capacity as the school testing consultant with the 
Minnesota State-^Wide Testing Programs I work closely with counselors and adminis^ 
trators in Minnesota School Systems and it is my observation that there is a 
tremendous need for evaluation personnel. Because of our pupil testing program, 
schools often turn to us for assistance with problems having to do with measure- 
ment and evaluation. Hardly a day passes without a letter or phone call from a 
school requesting assistance with some school evaluation problem. 

I have noticed a dramatic upturn in interest in evaluation on the part of Minnesota 
schools during the past few years. More than ever before schools are aware of the 
necessity for good evaluation and«we-are attempting evaluation projects. 

In trying to assist schools with evaluation projects and in attempting to refer 
them for help elsewhere, I have become very much aware of the real shortage of 
qualified people who are available for assisting schools. I also know a few 
school districts which have, hired full time evaluators recently and of others who 
would hire such people if they were available. 

I firmly believe that this proposal holds great potential for making an important 
and needed impact for the improvement of education in Minnesota. 




Sincerely yours 



GiJ/k 
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